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(54) Entropy coding by adapting coding between level and run-length/level modes 



(57) An audio encoder performs adaptive entropy 
encoding of audio data. For example, an audio encoder 
switches between variable dimension vector Huffinan 
coding of direct levels of quantized audio data and run- 
level coding of run lengths and levels of quantized audio 
data. The encoder can use, for example, context-based 
arithmetic coding for coding run lengths and levels. The 
encoder can determine when to switch between coding 
modes by counting consecutive coefficients having a 
predominant value (e.g., zero). An audio decoder per- 
forms corresponding adaptive entropy decoding. 
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Description 
FIELD 

5 [0001] The present invention relates to adaptive entropy encoding of audio data. For example, an audio encoder 
switches between Huffinan coding of direct levels of quantized audio data and arithmetic coding of run lengths and 
levels of quantized audio data. 

RELATED APPLICATION DATA 

10 

[0002] This application claims the benefit of U.S. Provisional Patent Application No. 60/408,538, filed September 4, 
2002, the disclosure of which is hereby incorporated herein by reference. 

[0003] The following concurrently filed U.S. patent applications relate to the present application: 1) U.S. Provisional 
Patent Application Serial No. 60/408,517, entitled, "Architecture and Techniques for Audio Encoding and Decoding," 
15 filed September 4, 2002, the disclosure of which is hereby incorporated by reference; and 2) U.S. Provisional Patent 
Application Serial No. 60/408,432, entitled, "Unified Lossy and Lossless Audio Compression," filed September 4, 2002, 
the disclosure of which is hereby incorporated by reference. 

BACKGROUND 

20 

[0004] With the introduction of compact disks, digital wireless telephone networks, and audio delivery over the In- 
ternet, digital audio has become commonplace. Engineers use a variety of techniques to process digital audio efficiently 
while still maintaining the quality of the digital audio. To understand these techniques, it helps to understand how audio 
information is represented and processed in a computer. 

25 

1. Representation of Audio Information In a Computer 

[0005] A computer processes audio information as a series of numbers representing the audio information. For ex- 
ample, a single number can represent an audio sample, which is an amplitude value (i.e., loudness) at a particular 
30 time. Several factors affect the quality of the audio information, including sample depth, sampling rate, and channel 
mode. 

[0006] Sample depth (or precision) indicates the range of numbers used to represent a sample. The more values 
possible for the sample, the higher the quality because the number can capture more subtle variations in amplitude. 
For example, an 8-bit sample has 256 possible values, while a 16-bit sample has 65,536 possible values. 
35 [0007] The sampling rate (usually measured as the number of samples per second) also affects quality. The higher 
the sampling rate, the higher the quality because more frequencies of sound can be represented. Some common 
sampling rates are 8,000, 11,025, 22,050, 32,000, 44,100, 48,000, and 96,000 samples/second. 
[0008] Table 1 shows several formats of audio with different quality levels, along with corresponding raw bitrate costs. 

40 Table 1 : 



Bltrates for different quality audio information 


Quality 


Sample Depth (bits/ 
sample) 


Sampling Rate 
(samples/second) 


Mode 


Raw Bitrate (bits/ 
second) 


Internet telephony 


6 


8,000 


mono 


64,000 


Telephone 


8 


11,025 


mono 


88,200 


CD audio 


16 


44,100 


stereo 


1,411,200 


High quality audio 


16 


48,000 


stereo 


1 ,536,000 



[0009] As Table 1 shows, the cost of high quality audio information such as CD audio is high bitrate. High quality 
audio information consumes large amounts of computer storage and transmission capacity. Companies and consumers 
increasingly depend on computers, however, to create, distribute, and play back high quality audio content. 

55 

II. Audio Compression and Decompression 

[0010] Many computers and computer networks lack the resources to process raw digital audio. Compression (also 



2 



EP1400 954 A2 



called encoding or coding) decreases the cost of storing and transmitting audio information by converting the informa- 
tion into a lower bitrate form. Compression can be lossless (in which quality does not suffer) or lossy (in which quality 
suffers but bitrate reduction through lossless compression is more dramatic). Decompression (also called decoding) 
extracts a reconstructed version of the original information from the compressed form. 

5 [0011] Generally, the goal of audio compression is to digitally represent audio signals to provide maximum signal 
quality with the least possible amount of bits. A conventional audio encoder/decoder ["codec"] system uses subband/ 
transform coding, quantization, rate control, and variable length coding to achieve its compression. The quantization 
and other lossy compression techniques introduce potentially audible noise into an audio signal. The audibility of the 
noise depends on how much noise there is and how much of the noise the listener perceives. The first factor relates 

10 mainly to objective quality, while the second factor depends on human perception of sound. The conventional audio 
encoder then losslessly compresses the quantized data using variable length coding to further reduce bitrate. 

A. Lossy Compression and Decompression of Audio Data 

15 [0012] Conventionally, an audio encoder uses a variety of different lossy compression techniques. These lossy com- 
pression techniques typically involve frequency transforms, perceptual modeling/weighting, and quantization. The cor- 
responding decompression involves inverse quantization, inverse weighting, and inverse frequency transforms. 
[0013] Frequency transform techniques convert data into a form that makes it easier to separate perceptually im- 
portant information from perceptually unimportant information. The less important information can then be subjected 

20 to more lossy compression, while the more important information is preserved, so as to provide the best perceived 
quality for a given bitrate. A frequency transformer typically receives the audio samples and converts them into data 
in the frequency domain, sometimes called frequency coefficients or spectral coefficients. 

[0014] Most energy in natural sounds such as speech and music is concentrated in the low frequency range. This 
means that, statistically, higher frequency ranges will have more frequency coefficients that are zero or near zero, 

25 reflecting the lack of energy in the higher frequency ranges. 

[0015] Perceptual modeling involves processing audio data according to a model of the human auditory system to 
improve the perceived quality of the reconstructed audio signal for a given bitrate. For example, an auditory model 
typically considers the range of human hearing and critical bands. Using the results of the perceptual modeling, an 
encoder shapes noise (e.g., quantization noise) in the audio data with the goal of minimizing the audibility of the noise 

30 for a given bitrate. While the encoder must at times introduce noise (e.g., quantization noise) to reduce bitrate, the 
weighting allows the encoder to put more noise in bands where it is less audible, and vice versa. 
[001 6] Quantization maps ranges of input values to single values, introducing irreversible loss of information or quan- 
tization noise, but also allowing an encoder to regulate the quality and bitrate of the output. Sometimes, the encoder 
performs quantization in conjunction with a rate controller that adjusts the quantization to regulate bitrate and/or quality. 

35 There are various kinds of quantization, including adaptive and non-adaptive, scalar and vector, uniform and non- 
uniform. Perceptual weighting can be considered a form of non-uniform quantization. 

[0017] Inverse quantization and inverse weighting reconstruct the weighted, quantized frequency coefficient data to 
an approximation of the original frequency coefficient data. The inverse frequency transformer then converts the re- 
constructed frequency coefficient data into reconstructed time domain audio samples. 

40 

B. Lossless Compression and Decompression of Audio Data 

[0018] Conventionally, an audio encoder uses one or more of a variety of different lossless compression techniques. 
In general, lossless compression techniques include run-length encoding, Huffman encoding, and arithmetic coding. 
45 The corresponding decompression techniques include run-length decoding, Huffman decoding, and arithmetic decod- 
ing. 

[0019] Run-length encoding is a simple, well-known compression technique used for camera video, text, and other 
types of content. In general, run-length encoding replaces a sequence (i.e., run) of consecutive symbols having the 
same value with the value and the length of the sequence. In run-length decoding, the sequence of consecutive symbols 

so js reconstructed from the run value and run length. Numerous variations of run-length encoding/decoding have been 
developed. For additional information about run-length encoding/decoding and some of its variations, see, e.g., Bell 
et al., Text Compression, Prentice Hall PTR, pages 105-107, 1990; Gibson et al., Digital Compression for Multimedia, 
Morgan Kaufmann, pages 17-62, 1998; U.S. Patent No. 6,304,928 to Mairs et al.; U.S. Patent No. 5,883,633 to Gill et 
al; and U.S. Patent No. 6,233,017 to Chaddha. 

55 [0020] Run-level encoding is similar to run-length encoding in that runs of consecutive symbols having the same 
value are replaced with run lengths. The value for the runs is the predominant value (e.g., 0) in the data, and runs are 
separated by one or more levels having a different value (e.g., a non-zero value). 

[0021] The results of run-length encoding (e.g. s the run values and run lengths) or run-level encoding can be Huffman 
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encoded to further reduce bitrate. If so, the Huffman encoded data is Huffman decoded before run-length decoding. 
[0022] Huff Inan encoding is another well-known compression technique used for camera video, text, and other types 
of content. In general, a Huffman code table associates variable-length Huffman codes with unique symbol values (or 
unique combinations of values). Shorter codes are assigned to more probable symbol values, and longer codes are 

5 assigned to less probable symbol values. The probabilities are computed for typical examples of some kind of content. 
Or, the probabilities are computed for data just encoded or data to be encoded, in which case the Huffman codes adapt 
to changing probabilities for the unique symbol values. Compared to static Huffman coding, adaptive Huffman coding 
usually reduces the bitrate of compressed data by incorporating more accurate probabilities for the data, but extra 
information specifying the Huffinan codes may also need to be transmitted. 

10 [0023] To encode symbols, the Huffman encoder replaces symbol values with the variable-length Huffman codes 
associated with the symbol values in the Huffinan code table. To decode, the Huffman decoder replaces the Huffman 
codes with the symbol values associated with the Huffman codes. 

[0024] In scalar Huffman coding, a Huffman code table associates a single Huffinan code with one value, for example, 
a direct level of a quantized data value. In vector Huffman coding, a Huffinan code table associates a single Huffinan 

is code with a combination of values, for example, a group of direct levels of quantized data values in a particular order. 
Vector Huffman encoding can lead to better bitrate reduction than scalar Huffman encoding (e.g., by allowing the 
encoder to exploit probabilities fractionally in binary Huffman codes). On the other hand, the codebook for vector Huff- 
man encoding can be extremely large when single codes represent large groups of symbols or symbols have large 
ranges of potential values (due to the large number of potential combinations). For example, if the alphabet size Is 256 

20 (for values 0 to 255 per symbol) and the number of symbols per vector is 4, the number of potential combinations is 
256 4 = 4,294,967,296. This consumes memory and processing resources in computing the codebook and finding 
Huffman codes, and consumes transmission resources in transmitting the codebook. 

[0025] Numerous variations of Huffman encoding/decoding have been developed. For additional information about 
Huffman encoding/decoding and some of its variations, see, e.g., Bell et al., Text Compression, Prentice Hall PTR, 

25 pages 105-107, 1990; Gibson et al., Digital Compression for Multimedia, Morgan Kaufmann, pages 17-62, 1998. 

[0026] U.S. Patent No. 6,223,1 62 to Chen et al. describes multi-level run-length coding of audio data. A frequency 
transformation produces a series of frequency coefficient values. For portions of a frequency spectrum in which the 
predominant value is zero, a multi-level run-length encoder statistically correlates runs of zero values with adjacent 
non-zero values and assigns variable length code words. An encoder uses a specialized codebook generated with 

30 respect to the probability of receiving an input run of zero-valued spectral coefficients followed by a non-zero coefficient. 
A corresponding decoder associates a variable length code word with a run of zero value coefficients and adjacent 
non-zero value coefficient. 

[0027] U.S. Patent No. 6,377,930 to Chen et al. describes variable to variable length encoding of audio data. An 
encoder assigns a variable length code to a variable size group of frequency coefficient values. 

35 [0028] U.S. Patent No. 6,300,888 to Chen et al. describes entropy code mode switching for frequency domain audio 
coding. A frequency-domain audio encoder selects among different entropy coding modes according to the character- 
istics of an input stream. In particular, the input stream is partitioned into frequency ranges according to statistical 
criteria derived from statistical analysis of typical or actual input to be encoded. Each range is assigned an entropy 
encoder optimized to encode that range's type of data. During encoding and decoding, a mode selector applies the 

^o correct method to the different frequency ranges. Partition boundaries can be decided in advance, allowing the decoder 
to implicitly know which decoding method to apply to encoded data. Or, adaptive arrangements may be used, in which 
boundaries are flagged in the output stream to indicate a change in encoding mode for subsequent data. For example, 
a partition boundary separates primarily zero quantized frequency coefficients from primarily non-zero quantized co- 
efficients, and then applies coders optimized for such data. 

45 [0029] For additional detail about the Chen patents, see the patents themselves. 

[0030] Arithmetic coding is another well-known compression technique used for camera video and other types of 
content. Arithmetic coding is sometimes used in applications where the optimal number of bits to encode a given input 
symbol is a fractional number of bits, and in cases where a statistical correlation among certain individual input symbols 
exists. Arithmetic coding generally involves representing an input sequence as a single number within a given range. 

so Typically, the number is a fractional number between 0 and 1 . Symbols in the input sequence are associated with 
ranges occupying portions of the space between 0 and 1 . The ranges are calculated based on the probability of the 
particular symbol occurring in the input sequence. The fractional number used to represent the input sequence is 
constructed with reference to the ranges. Therefore, probability distributions for input symbols are important in arith- 
metic coding schemes. 

55 [0031] In context-based arithmetic coding, different probability distributions for the input symbols are associated with 
different contexts. The probability distribution used to encode the input sequence changes when the context changes. 
The context can be calculated by measuring different factors that are expected to affect the probability of a particular 
input symbol appearing in an input sequence. For additional information about arithmetic encoding/decoding and some 
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of its variations, see Nelson, The Data Compression Book, "Huffman One Better: Arithmetic Coding," Chapter 5, pp. 
123-65(1992). 

[0032] Various codec systems and standards use lossless compression and decompression, including versions of 
Microsoft Corporation's Windows Media Audio ["WMA") encoder and decoder. Other codec systems are provided or 
5 specified by the Motion Picture Experts Group, Audio Layer 3 ("MP3 B ] standard; the Motion Picture Experts Group 2, 
Advanced Audio Coding f'AAC"] standard, and Dolby AC3. For additional information, see the respective standards 
or technical publications. 

[0033] Whatever the advantages of prior techniques and systems for lossless compression of audio data, they do 
not have the advantages of the present invention. 

10 

SUMMARY 

[0034] In summary, the detailed description is directed to various techniques and tools for adaptive entropy encoding 
and decoding of audio data. The various techniques and tools can be used in combination or independently. 

15 [0035] In one aspect, an encoder encodes a first portion of an audio data sequence in a direct variable-dimension 
vector Huffman encoding mode, switches to a run-level encoding mode at a switch point, and encodes a second portion 
in the run-level encoding mode (e.g., context-based arithmetic encoding, Huffman coding, vector Huffman coding). For 
example, the first portion consists primarily of non-zero quantized audio coefficients, and the second portion consists 
primarily of zero-value quantized audio coefficients. The switch point can be pre-determined (e.g., by testing efficiency 

20 of encoding the sequence using the switch point) or adaptively determined. The encoder can send a flag indicating 
the switch point in an encoded bitstream. 

[0036] In another aspect, a decoder decodes a first portion of an encoded sequence in a direct variable-dimension 
vector Huffman decoding mode, switches to a run-level decoding mode at a switch point, and decodes a second portion 
in the run-level decoding mode (e.g. , context-based arithmetic decoding, Huffman decoding, vector, Huffman decoding). 
25 Prior to switching, the decoder can receive a flag indicating the switch point. 

[0037] In another aspect, an encoder or decoder encodes or decodes a first portion of a sequence in a direct context- 
based arithmetic mode, switches to a run-level mode at a switch-point, and encodes or decodes a second portion in 
the run-level mode. The run-level mode can be context-based arithmetic mode. 

[0038] In another aspect, an encoder selects a first code table from a set of plural code tables based on the number 
30 of symbols in a first vector and represents the first vector with a code from the first code table. The first code table can 
include codes for representing probable vectors having that number of symbols, and an escape code for less probable 
vectors. The encoder also encodes a second vector having a different number of symbols. For example, the first vector 
has a greater number of symbols than the second vector and has a higher probability of occurrence than the second 
vector. To encode the second vector, the encoder can select a second, different code table based on the number of 
35 symbols in the second vector. If the second vector has one symbol, the encoder can represent the second vector using 
a table-less encoding technique. 

[0039] In another aspect, a decoder decodes a first vector by receiving a first code and looking up the first code in 
a first code table. If the first code is an escape code, the decoder receives and decodes a second code that is not in 
the first table. If the first code is not an escape code, the decoder looks up symbols for the first vector in the first table 

*o and includes them in a decoded data stream. The number of symbols in the first vector is the basis for whether the 
first code is an escape code. The decoder can decode the second code by looking it up in a second table. If the second 
code is an escape code, the decoder receives and decodes a third code representing the first vector that is not in the 
second table. If the second code is not an escape code, the decoder looks up symbols for the first vector in the second 
table and includes the symbols in the decoded data stream. 

45 [0040] In another aspect, an encoder encodes audio data coefficients using a table-less encoding technique, if a 
coefficient is within a first value range, the encoder encodes the coefficient with a one-bit code followed by an 8-bit 
encoded value. For other value ranges, the encoder encodes the coefficient with a two-bit code followed by a 16-bit 
encoded value, a three-bit code followed by a 24-bit encoded value, or a different three-bit code followed by a 31 -bit 
encoded value. 

so [0041] In another aspect, in a vector Huffman encoding scheme, an encoder determines a Huffinan code from a 
group of such codes to use for encoding a vector and encodes the vector using the Huffinan code. The determination 
of the code is based on a sum of values of the audio data symbols in the vector. If the Huffman code is an escape 
code, it indicates that an n-dimension vector is to be encoded as x n/x-dimension vectors using at least one different 
code table. The encoder can compare the sum with a threshold that depends on the number of symbols in the vector. 

55 For example, the threshold is 6 for 4 symbols, 16 for 2 symbols, or 100 for 1 symbol. 

[0042] In another aspect, an encoder receives a sequence of audio data and encodes at least part of the sequence 
using context-based arithmetic encoding. A decoder receives an encoded sequence of audio data coefficients and 
decodes at least part of the encoded sequence using context-based arithmetic decoding. 
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[0043] In another aspect, an encoder encodes audio data coefficients using context-based arithmetic coding. One 
or more contexts have associated probability distributions representing probabilities of coefficients. The encoder adap- 
trvely determines a context for a current coefficient based at least in part on a mode of representation of the current 
coefficient and encodes the current coefficient using the context. For example, if the mode of representation is direct, 

5 the encoder adaptively determines the context based at least in part on the direct levels of previous coefficients (e.g., 
the two coefficients immediately preceding the current coefficient). If the mode of representation is run-level, the en- 
coder adaptively determines the context based at least in part on the percentage of zero-value coefficients the previous 
run length of zero-value coefficients in the audio input sequence. If the mode of representation is run-level, and the 
encoder adaptively determines the context based at least in part on the current run length of zero-value coefficients, 

io the previous run length of zero-value coefficients, and the direct levels of previous coefficients. 

[0044] In another aspect, an encoder or decoder encodes or decodes a first portion of audio data using direct en- 
coding or decoding, maintaining a count of consecutive coefficients equal to a predominant value (e.g., 0). if the count 
exceeds a threshold, the encoder or decoder encodes or decodes a second portion of the audio data using run-level 
encoding or decoding. The threshold can be static or determined adaptively. The threshold can depend on the size of 

15 the block of coefficients. For example, the threshold can be 4 for a block of 256 coefficients, or 8 for a block of 512 
coefficients. 

[0045] In another aspect, an encoder or decoder encodes or decodes a first portion of a sequence using a first code 
table and a second portion of the sequence using a second code table. The first table is used when longer runs of 
consecutive coefficients equal to a predominant value (e.g., 0) are more likely, and the second table is used when 
20 shorter runs of consecutive coefficients of equal value are more likely. The table that is used can be indicated by a 
signal bit. 

[0046] The features and advantages of the adaptive entropy encoding and decoding techniques will be made ap- 
parent from the following detailed description of various embodiments that proceeds with reference to the accompa- 
nying drawings. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0047] 

30 Figure 1 is a block diagram of a suitable computing environment in which described embodiments may be imple- 

mented. 

Figure 2 is a block diagram of an audio encoder in which described embodiments may be implemented. 
Figure 3 is a block diagram of an audio decoder in which described embodiments may be implemented. 
Figure 4 is flowchart showing a generalized multi-mode audio encoding technique. 
35 Figure 5 is a flowchart showing a multi-mode audio encoding technique with adaptive switch point calculation. 

Figure 6 is a flowchart showing a generalized multi-mode audio decoding technique. 
Figure 7 is a flowchart showing a generalized variable-dimension vector Huffman encoding technique. 
Figure 8 is a flowchart showing a detailed technique for encoding audio data using variable-dimension vector 
Huffman encoding. 

40 Figure 9 is a flowchart showing a technique for variable-dimension vector Huffman coding of direct signal levels 

where the encoder adaptively determines a switch point for changing to coding of run lengths and signal levels. 
Figure 10 is a flowchart showing a generalized variable-dimension vector Huffinan decoding technique. 
Figure 1 1 is a flowchart showing a detailed technique for decoding vectors coded using variable-dimension vector 
Huffman encoding. 

45 Figure 12 is a flowchart showing a technique for variable-dimension vector Huffman decoding of direct signal levels 

where the decoder adaptively determines a switch point for changing to decoding of run lengths and signal levels. 
Figures 13A-13D are probability distributions for non run-length levels in a context-based arithmetic encoding 
scheme. 

Figures 14A-14H are probability distributions for different run lengths in a context-based arithmetic encoding 
50 scheme. 

Figures 1 5A-1 5H are probability distributions for run-length encoded levels in a context-based arithmetic encoding 
scheme. 

Figure 16 is a flowchart showing a technique for direct context-based arithmetic coding of coefficients where a 
switch point for changing to coding of run lengths and levels is determined adaptively by the encoder. 
55 Figure 1 7 is a flowchart showing a technique for context-based arithmetic decoding where the decoder adaptively 

determines a switch point for changing to decoding of run lengths and signal levels. 
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DETAILED DESCRIPTION 

[0048] In described embodiments, an audio encoder performs several adaptive entropy encoding techniques. The 
adaptive entropy encoding techniques improve the performance of the encoder, reducing bitrate and/or improving 
5 quality. A decoder performs corresponding entropy decoding techniques. While the techniques are described in places 
herein as part of a single, integrated system, the techniques can be applied separately, potentially In combination with 
other techniques. 

[0049] The audio encoder and decoder process discrete audio signals. In the described embodiments, the audio 
signals are quantized coefficients from frequency transformed audio signals. Alternatively, the encoder and decoder 
10 process another kind of discrete audio signal or discrete signal representing video or another kind of information. 
[0050] In some embodiments, an audio encoder adaptively switches between coding of direct signal levels and coding 
of run lengths and signal levels. The encoder encodes the direct signal levels using scalar Huffman codes, vector 
Huffman codes, arithmetic coding, or another technique. In the run length/level coding (also called run-level coding), 
each run length represents a run of zero or more zeroes and each signal level represents a non-zero value. In the run- 
's level event space, the encoder encodes run lengths and levels in that event space using Huffman codes, arithmetic 
coding, or another technique. A decoder performs corresponding adaptive switching during decoding. The adaptive 
switching occurs when a threshold number of zero value levels is reached. Alternatively, the encoder and decoder 
switch based upon additional or other criteria. 

[0051] In some embodiments, an audio encoder uses variable-dimension vector Huffman encoding. The variable- 
20 dimension vector Huffinan coding allows the encoder to use Huffman codes to represent more probable combinations 
of symbols using larger dimension vectors, and less probable combinations of symbols using smaller dimension vectors 
or scalars. A decoder performs corresponding variable-dimension Huffman decoding. 

[0052] In some embodiments, an audio encoder uses context-based arithmetic coding. The contexts used by the 
encoder allow efficient compression of different kinds of audio data. A decoder performs corresponding context-based 
25 arithmetic decoding. 

[0053] In described embodiments, the audio encoder and decoder perform various techniques. Although the oper- 
ations for these techniques are typically described in a particular, sequential order for the sake of presentation, it should 
be understood that this mannerof description encompasses minor rearrangements in the order of operations. Moreover, 
for the sake of simplicity, flowcharts typically do not show the various ways in which particular techniques can be used 
30 in conjunction with other techniques. 

I. Computing Environment 

[0054] Figure 1 illustrates a generalized example of a suitable computing environment (100) in which described 
35 embodiments may be implemented. The computing environment (100) is not intended to suggest any limitation as to 
scope of use or functionality of the invention, as the present invention may be implemented in diverse general-purpose 
or special-purpose computing environments. 

[0055] With reference to Figure 1 , the computing environment (1 00) includes at least one processing unit (1 1 0) and 
memory (120). In Figure 1, this most basic configuration (130) is included within a dashed line. The processing unit 

4 0 (1 1 0) executes computer-executable instructions and may be a real or a virtual processor. In a multi-processing system, 
multiple processing units execute computer-executable instructions to increase processing power. The memory (120) 
may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory, etc.), 
or some combination of the two. The memory (120) stores software (180) implementing an audio encoder/decoder 
that performs adaptive entropy coding/decoding of audio data. 

45 [0056) A computing environment may have additional features. For example, the computing environment (100) in- 
cludes storage (140), one or more input devices (150), one or more output devices (160), and one or more communi- 
cation connections (170). An interconnection mechanism (not shown) such as a bus, controller, or network intercon- 
nects the components of the computing environment (100). Typically, operating system software (not shown) provides 
an operating environment for other software executing in the computing environment (100), and coordinates activities 

so of the components of the computing environment (100). 

[0057] The storage (140) may be removable or non-removable, and includes magnetic disks, magnetic tapes or 
cassettes, CD-ROMs, CD-RWs, DVDs, or any other medium which can be used to store information and which can 
be accessed within the computing environment (100). The storage (140) stores instructions for the software (180) 
implementing the audio encoder/decoder that performs adaptive entropy coding/decoding of audio data. 

55 [0058] The input device(s) (150) may be a touch input device such as a keyboard, mouse, pen, or trackball, a voice 
input device, a scanning device, network adapter, or another device that provides input to the computing environment 
(100). For audio, the input device(s) (150) may be a sound card or similar device that accepts audio input in analog or 
digital form, or a CD-ROM reader that provides audio samples to the computing environment. The output device(s) 
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(160) may be a display, printer, speaker, CD/DVD-writer, network adapter, or another device that provides output from 
the computing environment (100). 

[0059] The communication connection(s) (170) enable communication over a communication medium to another 
computing entity. The communication medium conveys information such as computer-executable instructions, com- 
5 pressed audio information, or other data in a modulated data signal. A modulated data signal is a signal that has one 
or more of its characteristics set or changed to encode information in the signal. By way of example, and not limitation, 
communication media include wired or wireless techniques implemented with an electrical, optical, RF, infrared, acous- 
tic, or other carrier. 

[0060] The invention can be described in the general context of computer-readable media. Computer-readable media 
10 are any available media that can be accessed within a computing environment. By way of example, and not limitation, 
within the computing environment (100), computer-readable media include memory (120), storage (140), communica- 
tion media, and combinations of any of the above. 

[0061] The invention can be described in the general context of computer-executable instructions, such as those 
included in program modules, being executed in a computing environment on a target real or virtual processor. Gen- 

is eraily, program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that 
perform particular tasks or implement particular abstract data types. The functionality of the program modules may be 
combined or split between program modules as desired in various embodiments. Computer-executable instructions 
for program modules may be executed within a local or distributed computing environment. 
[0062] For the sake of presentation, the detailed description uses terms like "analyze," "send," "compare," and 

20 "check" to describe computer operations in a computing environment. These terms are high-level abstractions for 
operations performed by a computer, and should not be confused with acts performed by a human being. The actual 
computer operations corresponding to these terms vary depending on implementation. 

II. Generalized Audio Encoder and Decoder 

25 

[0063] Figure 2 is a block diagram of a generalized audio encoder (200) in which described embodiments may be 
implemented. The encoder (200) performs adaptive entropy coding of audio data. Figure 3 is a block diagram of a 
generalized audio decoder (300) in which described embodiments may be implemented. The decoder (300) decodes 
encoded audio data. 

30 [0064] The relationships shown between modules within the encoder and decoder indicate a flow of information in 
an exemplary encoder and decoder; other relationships are not shown for the sake of simplicity. Depending on imple- 
mentation and the type of compression desired, modules of the encoder or decoder can be added, omitted, split into 
multiple modules, combined with other modules, and/or replaced with like modules, in alternative embodiments, en- 
coders or decoders with different modules and/or other configurations perform adaptive entropy coding and decoding 

35 of audio data. 

A. Generalized Audio Encoder 

[0065] The generalized audio encoder (200) includes a selector (208), a multi-channel pre-processor (210), a par- 
40 titioner/tile configurer (220), a frequency transformer (230), a perception modeler (240), a weighter (242), a multi- 
channel transformer (250), a quantizer (260), an entropy encoder (270), a controller (280), a mixed/pure lossless coder 
(272) and associated entropy encoder (274), and a bitstream multiplexer ["MUX"] (290). Description about some of the 
modules of the encoder (200) follows. For description about the other modules of the encoder (200) in some embod- 
iments, see the applications referenced in the Related Application Data section. 
45 [0066] The encoder (200) receives a time series of input audio samples (205) at some sampling depth and rate in 
pulse code modulated [ W PCM W ] format. The input audio samples (205) can be multi-channel audio (e.g., stereo mode, 
surround) or mono. The encoder (200) compresses the audio samples (205) and multiplexes information produced by 
the various modules of the encoder (200) to output a bitstream (295) in a format such as a Windows Media Audio 
["WMA"] format or Advanced Streaming Format ["ASF"). Alternatively, the encoder (200) works with other input and/ 
50 or output formats. 

[0067] Initially, the selector (208) selects between multiple encoding modes for the audio samples (205). In Figure 
2, the selector (208) switches between two modes: a mixed/pure* lossless coding mode and a lossy coding mode. The 
lossless coding mode includes the mixed/pure lossless coder (272) and is typically used for high quality (and high 
bitrate) compression. The lossy coding mode includes components such as the weighter (242) and quantizer (260) 
55 and is typically used for adjustable quality (and controlled bitrate) compression. The selection decision at the selector 
(208) depends upon user input (e.g., a user selecting lossless encoding for making high quality audio copies) or other 
criteria. In other circumstances (e.g., when lossy compression fails to deliver adequate quality or overproduces bits), 
the encoder (200) may switch from lossy coding over to mixed/pure lossless coding for a frame or set of frames. 
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[0068] The frequency transformer (230) receives the audio samples (205) and converts them into data in the fre- 
quency domain. The frequency transformer (230) outputs blocks of frequency coefficient data to the weighter (242) 
and outputs side information such as block sizes to the MUX (290). The frequency transformer (230) outputs both the 
frequency coefficients and the side information to the perception modeler (240). 

s [0069] The perception modeler (240) models properties of the human auditory system to improve the perceived 
quality of the reconstructed audio signal for a given bitrate. Generally, the perception modeler (240) processes the 
audio data according to an auditory model, then provides information to the weighter (242) which can be used to 
generate weighting factors for the audio data. The perception modeler (240) uses any of various auditory models and 
passes excitation pattern information or other information to the weighter (242). 

10 [0070] As a quantization band weighter, the weighter (242) generates weighting factors for a quantization matrix 
based upon the information received from the perception modeler (240) and applies the weighting factors to the data 
received from the frequency transformer (230). The weighter (242) outputs side information such as the set of weighting 
factors to the MUX (290). As a channel weighter, the weighter (242) then generates channel-specific weighting factors 
based on the information received from the perception modeler (240) and also on the quality of locally reconstructed 

is signal. These scalar weights allow the reconstructed channels to have approximately uniform quality. The weighter 
(242) outputs weighted blocks of coefficient data to the multi-channel transformer (250) and outputs side information 
such as the set of channel weight factors to the MUX (290). Alternatively, the encoder (200) uses another form of 
weighting or skips weighting. 

[0071] For multi-channel audio data, the multiple channels of noise-shaped frequency coefficient data produced by 
20 the weighter (242) often correlate. To exploit this correlation, the multi-channel transformer (250) can apply a multi- 
channel transform to the audio data. The multi-channel transformer (250) produces side information to the MUX (290) 
indicating, for example, the multi-channel transforms used and multi-channel transformed parts of frames. 
[0072] The quantizer (260) quantizes the output of the multi-channel transformer (250), producing quantized coeffi- 
cient data to the entropy encoder (270) and side information including quantization step sizes to the MUX (290). Quan- 
25 tization introduces irreversible loss of information, but also allows the encoder (200) to regulate the quality and bitrate 
of the output bitstream (295) in conjunction with the controller (280). In some embodiments, the quantizer (260) is an 
adaptive, uniform, scalar quantizer. In alternative embodiments, the quantizer is a non-uniform quantizer, a vector 
quantizer, and/or a non-adaptive quantizer, or uses a different form of adaptive, uniform, scalar quantization. 
[0073] The entropy encoder (270) losslessly compresses quantized coefficient data received from the quantizer 
30 (260). In some embodiments, the entropy encoder (270) uses adaptive entropy encoding as described in the sections 
below. The entropy encoder (270) can compute the number of bits spent encoding audio information and pass this 
information to the rate/quality controller (280). 

[0074] The controller (280) works with the quantizer (260) to regulate the bitrate and/or quality of the output of the 
encoder (200). The controller (280) receives information from other modules of the encoder (200) and processes the 

35 received information to determine desired quantization factors given current conditions. The controller (280) outputs 
the quantization factors to the quantizer (260) with the goal of satisfying quality and/or bitrate constraints. 
[0075] The mixed lossless/pure lossless encoder (272) and associated entropy encoder (274) compress audio data 
for the mixed/pure lossless coding mode. The encoder (200) uses the mixed/pure lossless coding mode for an entire 
sequence or switches between coding modes on a frame-by-frame or other basis. 

40 [0076] The MUX (290) multiplexes the side information received from the other modules of the audio encoder (200) 
along with the entropy encoded data received from the entropy encoder (270). The MUX (290) outputs the information 
in a WMA format or another format that an audio decoder recognizes. The MUX (290) includes a virtual buffer that 
stores the bitstream (295) to be output by the encoder (200). The current fullness of the buffer, the rate of change of 
fullness of the buffer, and other characteristics of the buffer can be used by the controller (280) to regulate quality and/ 

^5 orbitrate for different applications (e.g., atconstant quality/variable bitrate, at or below constant bitrate/variable quality). 

B. Generalized Audio Decoder 

[0077] With reference to Figure 3, the generalized audio decoder (300) includes a bitstream demultiplexer ["DEMUX"] 
50 (310), one or more entropy decoders (320), a mixed/pure lossless decoder (322), a tile configuration decoder (330), 
an inverse multi-channel transformer (340), an inverse quantizer/weighter (350), an inverse frequency transformer 
(360), an overtapper/adder (370), and a multi-channel post-processor (380). The decoder (300) is somewhat simpler 
than the encoder (300) because the decoder (300) does not include modules for rate/quality control or perception 
modeling. Description about some of the modules of the decoder (300) follows. For description about the other modules 
55 of the decoder (300) in some embodiments, see the applications referenced in the Related Application Data section. 
[0078] The decoder (300) receives a bitstream (305) of compressed audio information in a WMA format or another 
format. The bitstream (305) includes entropy encoded data as well as side information from which the decoder (300) 
reconstructs audio samples (395). 
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[0079] The DEMUX (310) parses information in the bitstream (305) and sends information to the modules of the 
decoder (300). The DEMUX (310) includes one or more buffers to compensate for short-term variations in bitrate due 
to fluctuations in complexity of the audio, network jitter, and/or other factors. 

[0080] The one or more entropy decoders (320) losslessly decompress entropy codes received from the DEMUX 
5 (31 0). For the sake of simplicity, one entropy decoder module is shown in Figure 3, although different entropy decoders 
may be used for lossy and lossless coding modes, or even within modes. Also, for the sake of simplicity, Figure 3 does 
not show mode selection logic. The entropy decoder (320) typically applies the inverse of the entropy encoding tech- 
nique used in the encoder (200). When decoding data compressed in lossy coding mode, the entropy decoder (320) 
produces quantized frequency coefficient data. 
io [0081] The mixed/pure lossless decoder (322) and associated entropy decoder(s) (320) decompress losslessly en- 
coded audio data for the mixed/|3ure lossless coding mode. The decoder (300) uses a particular decoding mode for 
an entire sequence, or switches decoding modes on a frame-by-frame or other basis. 

[0082] The inverse multi-channel transformer (340) receives the entropy decoded quantized frequency coefficient 
data from the entropy decoders) (320) as well as side information from the DEMUX (310) indicating, for example, the 

15 multi-channel transform used and transformed parts of frames. N 

[0083] The inverse quantizer/weighter (350) receives quantization factors as well as quantization matrices from the 
DEMUX (310) and receives quantized frequency coefficient data from the inverse multi-channel transformer (340). The 
inverse quantizer/weighter (350) decompresses the received quantization factor/matrix information as necessary, then 
performs the inverse quantization and weighting. 

20 [0084] The inverse frequency transformer (360) receives the frequency coefficient data output by the inverse quan- 
tizer/weighter (350) as well as side information from the DEMUX (31 0). The inverse frequency transformer (360) applies 
the inverse of the frequency transform used in the encoder and outputs blocks to the overlapper/adder (370). 
[0085] The overlapper/adder (370) receives decoded information from the inverse frequency transformer (360) and/ 
or mixed/pure lossless decoder (322). The overlapper/adder (370) overlaps and adds audio data as necessary and 

25 interleaves frames or other sequences of audio data encoded with different modes. 

IN. Adaptive Entropy Encoding/Decoding Mode Switching 

[0086] Run-level coding methods are often more effective than direct coding of levels when an input sequence con- 
30 tains many occurrences of a single value (e.g., 0). However, because non-zero quantized transform coefficients are 
common in audio data input sequences, especially in the lower frequencies, run-level coding is not effective across 
the entire range of frequencies. Moreover, in higher quality audio, non-zero quantized transform coefficients become 
more common even in higher frequencies. (In higher quality audio, quantization levels are typically smaller.) Therefore, 
in some embodiments, an encoder such as the encoder (200) of Figure 2 performs a multi-mode coding technique that 
35 can use run-level coding for one portion of an audio data input sequence and direct coding of levels for another portion 
of the sequence. A decoder such as the decoder (300) of Figure 3 performs a corresponding mufti-mode decoding 
technique. 

A. Adaptive Entropy Encoding Mode Switching 

40 

[0087] Referring to Figure 4, in a multi-mode encoding technique 400, the encoder first codes signal levels in an 
input stream directly (410). For example, the encoder performs variable-dimension Huffman coding, context-based 
arithmetic coding, or another entropy coding technique directly on the signal levels. 

[0088] At a switch point during the encoding, the encoder changes the coding scheme (420). The encoder may 
*5 change the encoding scheme at a pre-determined switch point, or the encoder may analyze the input data to determine 
an appropriate point to change coding schemes. For example, the encoder may analyze an input sequence to find the 
best point to switch to run-level coding, sending the switch point to the decoder in the output bitstream. Or, the encoder 
may calculate the switch point adaptively by counting consecutive zeroes (or alternatively, another predominant value) 
in the input data, and switch to run-level coding when a particular threshold number of consecutive zeroes has been 
so counted. The decoder can calculate the switch point in the same way, so the switch point need not be included in the 
bitstream. Or, the encoder and decoder use some other criteria to determine the switch point. 
[0089] After the switch point, the encoder codes remaining signal levels using run-level coding (430). For example, 
the encoder performs Huffman coding, context-based arithmetic coding, or another entropy coding technique on the 
run lengths and signal levels. The encoder may use the same technique (e.g., context-based arithmetic coding) before 
55 and after the switch point, or the encoder may use different techniques. 

[0090] Moreover, although Figure 4 and various other Figures in the application show a single switch point, additional 
switch points can be used to divide input data into more than two portions. For example, additional adaptive switch 
points can be set for increased thresholds of consecutive zeroes. Different encoding schemes can then be applied to 
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the different portions. Or, the encoder can experiment with different segmentation points in the sequence, weighing 
the coding efficiencies for different segmentation configurations along with the costs of signaling the different config- 
urations to the decoder. 

[0091] Figure 5 shows a multi-mode encoding technique (500) with adaptive switch point calculation according to 
5 one implementation. The adaptive switch point depends on a count of consecutive zero-value coefficients. The input 
data are signal levels for quantized transform coefficients, progressing from the lowest-frequency coefficient to the 
highest-frequency coefficient. In practice, the position of the switch point depends on the signal being compressed and 
the bitrate/quality of the encoding. Alternatively, the input data are another form and/or organization of audio data. 
[0092] To start, the encoder initializes several variables. Specifically, the encoder sets a run count variable to 0 (51 0) 
io and sets an encoding state variable to "direct" (51 2). 

[0093] The encoder receives the next coefficient QC as input (520). The encoder then checks (530) if the coefficient 
QC is zero. If the coefficient QC is non-zero, the encoder resets the run count (538). Otherwise (i.e., if the coefficient 
QC is zero), the encoder increments the run count variable (532), and checks to see whether the current run count 
exceeds the run count threshold (534). The run count threshold can be static or it can depend on a factor such as the 
15 size of a block of coefficients (e.g., a run count threshold of 4 for a sequence of 256 coefficients, 8 for a sequence of 
512 coefficients, etc.), or it can be adaptive in some other way. If the run count exceeds the threshold, the encoder 
changes the encoding state to run-level encoding ["RLE"] (536). 

[0094] The encoder then encodes the coefficient QC if appropriate (540). (In some cases, groups of coefficients are 
coded together using a technique such as vector Huffman coding. In such cases, the encoder may defer encoding the 
20 coefficient QC.) 

[0095] The encoder then checks (550) whether the encoder should switch encoding modes. In particular, the encoder 
checks the encoding state. If the encoding state is no longer direct (e.g., if the encoder has changed the encoding 
state to RLE as a result of reaching a threshold number of zero coefficients), the encoder begins run-level encoding 
of the coefficients (560). (Again, in cases in which groups of coefficients are coded together, the encoder may defer 
25 the switching decision until reaching a convenient break point for a group of coefficients.) 

[0096] If the encoder does not switch encoding modes, the encoder checks whether it has finished encoding the 
coefficients (570). If so, the encoder exits. Otherwise, the encoder inputs the next coefficient (520) to continue the 
encoding process. 

30 B. Adaptive Entropy Decoding Mode Switching 

[0097] Referring to Figure 6, in a multi-mode decoding technique (600), the decoder decodes directly coded signal 
levels (610). For example, the decoder performs variable-dimension Huffman decoding, context-based arithmetic de- 
coding, or another entropy decoding technique on directly coded signal levels. 

35 [0098] At a switch point during the decoding, the decoder changes the decoding scheme (620). If the switch point 
is pre-determined, the decoder may receive, in the form of a flag or other notification mechanism, data that explicitly 
tells the decoder when to change decoding schemes. Or, the decoder may adaptively calculate when to change de- 
coding schemes based on the input data it receives. If the decoder calculates the switch point, the decoder uses the 
same calculating technique used by the encoder to ensure that the decoding scheme changes at the correct point. For 

40 example, the decoder counts consecutive zeroes (or alternatively, another predominant value) to determine the switch 
point adaptively. In one implementation, the decoder uses a technique corresponding to the encoder technique shown 
in Figure 5. Or, the decoder uses some other criteria to determine the switch point. 

[0099] After the switch point, the decoder decodes remaining run-level coded signal levels (630). For example, the 
decoder performs Huffman decoding, context-based arithmetic decoding, or another entropy decoding technique on 
45 the encoded run lengths and signal levels. The decoder may use the same technique (e.g., context-based arithmetic 
decoding) before and after the switch point; or the decoder may use different techniques. 

iV. Variable Dimension Huffman Encoding and Decoding 

so [01 00] While symbols such as direct signal levels can be encoded using scalar Huffman encoding, such an approach 
is limited where the optimal number of bits for encoding a symbol is a fractional number. Scalar Huffman coding is also 
limited by the inability of scalar Huffman codes to account for statistical correlation between symbols. Vector Huffman 
encoding yields better bitrate reduction than scalar Huffman encoding (e.g., by allowing the encoder to exploit proba- 
bilities fractionally in binary Huffman codes). And, in general, higher-dimension vectors yield better bitrate reduction 

55 than smaller-dimension vectors. However, if a code is assigned to each possible symbol combination, codebook size 
increases exponentially as the vector dimension increases. For example, in a 32-bit system, the number of possible 
combinations for a 4-dimension vector is (2 32 ) 4 . The search time for matching a vector and finding a Huffman code 
also increases dramatically as codebook size increases. 
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[0101] In some embodiments, to reduce codebook size, an encoder such as the encoder (200) of Figure 2 uses a 
variable-dimension vector Huffman coding technique. Rather than assigning a codebook code to each possible n- 
dimensional combination, a limited number of the most probable n-dimension vectors are assigned codes. If a particular 
n-dimension vector is not assigned a code, the n-dimension vector is instead encoded as smaller dimension vectors 
5 (e.g., two n/2-dimension vectors), as scalars with Huffman codes, or as scaiars using some table-less technique for 
representing discrete values. A decoder such as the decoder (300) of Figure 3 reconstructs a vector by finding the 
code(s) for the vector and finding the associated values. 

[01 02J For example, in the case of 4-dimensional vectors with 256 values possible per symbol, the encoder encodes 
the 500 most probable 4-dimensional vectors with Huffman codes and uses an escape code to indicate other vectors. 
10 The encoder splits such other vectors into 2-dimensional vectors. The encoder encodes the 500 most probable 2-di- 
mensional vectors with Huffman codes and uses an escape code to indicate other vectors, which are split and coded 
with scalar Huffman codes. Thus, the encoder uses 501 + 501 + 256 codes. 

[0103] In terms of determining which vectors or scalars are represented with Huffman codes in a table, and in terms 
of assigning the Huffman codes themselves for a table, codebook construction can be static, adaptive to data previously 
15 encoded, or adaptive to the data to be encoded. 

A. Variable-dimension Vector Huffman Encoding 

[0104] Referring to Figure 7, an encoder uses a variable-dimension vector Huffinan fVDVH"] encoding technique 
2Q (700). For example, the encoder uses the technique (700) to directly encode signal levels for frequency coefficients of 
audio data. Alternatively, the encoder uses the technique (700) to encode another form of audio data. For the sake of 
simplicity, Figure 7 does not show codebook construction. Codebook construction can be static, adaptive to data pre- 
viously encoded, or adaptive to the data to be encoded. 

[0105] The encoder gets (710) the next vector of n symbols. For example, the encoder gets the next 4 symbols in 
25 sequence. 

[01 06] The encoder checks (720) whether the codebook includes a code for the vector. If so, the encoder uses (730) 
a single Huffinan code to encode the vector. For example, to determine how to encode an n-dimension vector, the 
encoder checks an n-dimension vector code table for a code associated with the vector. Because larger-dimension 
vectors usually yield greater bitrate savings, the encoder uses Huffman codes for the most probable, n-dimension 

30 vectors. But, to limit the size of the table, only some of the n-dimension vectors have associated codes. 

[01 07] If the codebook does not include a code for the vector, the encoder splits (740) the vector into smaller vectors 
and/or scalars and codes the smaller vectors and/or scalars. For example, the encoder splits a vector of n symbols 
into x n/x-symbol vectors. For each n/x symbol vector, the encoder recursively repeats the encoding technique, exiting 
when the n/x symbol vector or its constituent vectors/scalars are encoded with Huffinan codes or (for scalars) using a 

35 table-less technique for representing discrete values. 

[0108] The encoder then checks (750) whether there are any additional vectors to encode. If not, the encoder exits. 
Otherwise, the encoder gets (710) the next vector of n symbols. 

1. Example Implementation 

40 

[0109] Figure 8 shows a detailed technique (800) for encoding vectors using VDVH encoding in one implementation. 
In the technique (800), the encoder sums the integer values of the symbols in a vector of symbols to determine whether 
to encode the vector using a single Huffman code or split the vector into smaller vectors/scalars. This effectively limits 
codebook size and speeds up the search for codes. 

45 [01 10] A codebook table for n-dimension ["n-dim"] vectors includes Huffman codes for L, n-dim vectors. The code- 
book table also includes an escape code. The L 1 codes are for each vector for which the sum of the vector components 
(which are integers) is below a particular threshold T v For example, suppose n is 4 and the threshold T 1 for 4-dim 
vectors is 6. The codebook table for 4-dim vectors includes the escape code and 126 codes, one for each possible 
vector whose components (e.g., the absolute values of components) add up to less than 6 - (0, 0, 0, 0), (0, 0, 0, 1), 

50 etc. Limiting the table size based upon the component sum of vectors is effective because, generally, the most probable 
vectors are those with smaller component sums. 

[01 1 1 ] If the codebook table for n-dim vectors does not have a Huffman code for a particular n-dim vector, the encoder 
adds an escape code to the output bitstream and encodes the n-dim vector as smaller dimension vectors or scalars, 
looking up those smaller dimension vectors or scalars in other codebook tables. For example, the smaller dimension 
55 is n/2 unless n/2 is 1 , in which case the n-dim vector is split into scalars. Alternatively, the n-dim vector is split in some 
other way. 

[01 12] The codebook table for the smaller dimension vectors includes Huffman codes for Lj smaller dimension vec- 
tors as well as an escape code. The codes are for each vector for which the sum of the vector components is below 
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a particular threshold T 2 for the smaller dimension table. For example, suppose the smaller dimension is 2 and the 
threshold T 2 for 2-dim vectors is 1 6. The codebook table for 2-dim vectors includes the escape code and 136 codes, 
one for each possible vector whose components (e.g., the absolute values of components) add up to less than 16 - 
(0, 0), (0, 1), etc. 

5 [0113] If the codebook table for smaller dimension vectors does not have a Huffman code for a particular smaller 
dimension vector, the encoder adds an escape code to the output bitstream and encodes the vector as even smaller 
dimension vectors or scalars, using other codebook tables. This process repeats down to the scalar level. For example, 
the split is by a power of 2 down to the scalar level. Alternatively, the vector is split in some other way. 
[01 1 4] At the scalar level, the codebook table includes Huffman codes for L 3 scalars as well as an escape code. The 

10 Lg codes are for each scalar below a particular threshold T 3 (which assumes small values are more probable). For 
example, suppose the threshold T 3 for scalars is 100. The codebook table for scalars includes 100 codes and an 
escape code. If a scalar does not have an associated code in the scalar code table, the scalar is coded with the escape 
code and a value (e.g., literal) according to a table-less technique. Using all of the numerical examples given In this 
section, the tables would include a total of 126 + 1 + 136 + 1 + 100 + 1 = 365 codes. 

1$ [0115] The dimension sizes for tables, vector splitting factors, and thresholds for vector component sums depend 
on implementation. Other implementations use different vector sizes, different splitting factors, and/or different thresh- 
olds. Alternatively, an encoder uses criteria other than vector component sums to switch vector sizes/codebook tables 
In VDVH encoding. 

[01 16] With reference to Figure 8, the encoderfirst gets an n-dim vector (81 0).The n-dim vector comprises n symbols, 
20 each symbol, for example, having a value representing the quantized level for a frequency coefficient of audio data. 
[0117] The encoder sums the vector components (812) and compares the sum with a threshold (820) for n-dim 
vectors. If the sum is less than or equal to the threshold, the encoder codes the n-dim vector with a Huffman code from 
a code table (822), and continues until coding is complete (824). If the sum is greater than or equal to the threshold, 
the encoder sends an escape code (826) and splits the n-dim vector into two smaller vectors with dimensions of n/2 
25 (830). 

[0118] The encoder gets the next n/2-dim vector (840) and sums the components of the n/2-dim vector (842). The 
encoder checks the sum against a threshold associated with n/2-dim vectors (850). If the sum is less than or equal to 
the threshold, the encoder codes the n/2-dim vector with a Huffman code from a code table (852) for n/2-dim vectors, 
and gets the next n/2-dim vector (840) if the encoder has not finished encoding the n/2-dim vectors (854). If the sum 

30 is greater than the threshold for n/2-dim vectors, the encoder sends another escape code (856). 

[01 19] The encoder generally follows this pattern in processing the vectors, either coding each vector or splitting the 
vector into smaller-dimension vectors. In cases where the encoder splits a vector into two scalar (1 -dimension) com- 
ponents (860), the encoder gets the next scalar (870) and compares the value of the scalar with a threshold associated 
with scalar values (880). if the scalar value is less than or equal to the threshold (880), the encoder codes the scalar 

35 using a Huffman code from a code table (882) for scalars. If the scalar value is greater than the threshold, the encoder 
codes the scalar using a table-less technique (884). The encoder then gets the next scalar (870) if it has not finished 
processing the scalars (886). 

[0120] Alternatively, the encoder uses tables with different dimension sizes, splits vectors in some way other than 
by power of 2, and/or uses a criteria other than vector component sum to switch vector sizes/codebook tables in VDVH 
40 encoding. 

2. Adaptive Switching 

[0121] Figure 9 shows a technique (900) for VDVH coding of coefficients of direct signal levels where the encoder 
45 adaptivety determines a switch point for changing to coding of run lengths and signal levels according to one imple- 
mentation. The adaptive switch point depends on a count of consecutive zero-value coefficients. The input data are 
signal levels for quantized transform coefficients, progressing from the lowest-frequency coefficient to the highest- 
frequency coefficient. Alternatively, the input data are another form and/or organization of audio data. 
[0122] To start, the encoder initializes several variables. Specifically, the encoder sets a run count variable to 0 (910), 
so sets a current vector variable to empty (912), and sets an encoding state variable to direct variable-dimension vector 
Huffinan ["DVDVH"] (914). 

[01 23] The encoder receives the next coefficient QC as input (920). The encoder then checks (930) if the coefficient 
is zero. If the coefficient QC is non-zero, the encoder resets the run count (938) and adds the coefficient QC to the 
current vector (940). Otherwise (i.e., if the coefficient QC is zero), the encoder increments the run count variable (932), 
55 and checks to see whether the current run count exceeds the run count threshold (934). The run count threshold can 
be static or it can depend on a factor such as the size of a block of coefficients (e.g., four zeroes in an input sequence 
of 256 coefficients), or it can be adaptive in some other way. For example, the threshold may be Increased or decreased, 
with or without regard to the number of coefficients in an input sequence. If the run count exceeds the threshold, the 
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encoder changes the encoding state to run-level encoding ["RLE") (936), and the coefficient QC is added as a com- 
ponent to the current vector (940). 

[0124] Adding the coefficient QC to the current vector increments the dimension of the vector. The encoder deter- 
mines (950) whether the current vector is ready to encode by comparing the number of components in the current 

5 vector with the maximum dimension for the current vector. If so, the encoder encodes the current vector using DVDVH 
coding (960). If the current vector is smaller than the maximum dimension, but the coefficient QC is the last in a se- 
quence, the encoder can pad the current vector and encode it using DVDVH coding (960). The maximum dimension 
depends on implementation. In one implementation, it is 8. However, the maximum dimension may be increased or 
decreased depending on, for example, the amount of resources available for creating, storing or transmitting a code- 

10 book. 

[01 25) After encoding the vector, the encoder checks the encoding state (970). If the encoding state is no longer 
DVDVH (e.g., if the encoder has changed the encoding state to RLE as a result of exceeding a threshold number of 
zero coefficients), the encoder begins encoding of the coefficients as run lengths and levels (980). Run-level encoding 
can be performed in several ways, including, for example, Huffman coding, vector Huffman coding, or context-based 
15 arithmetic coding. In some embodiments, run-level encoding is performed using Huffman coding with two Huffman 
code tables, where one table is used for encoding data in which shorter runs are more likely, and one table is used for 
encoding data in which longer runs are more likely. The encoder tries each table, and chooses codes from one of the 
tables, with a signal bit indicating which table the encoder used. 

[0126] If the encoding state has not changed or the current vector is not ready for encoding, the encoder determines 
20 (990) whether there are any more coefficients to be encoded. If so, the encoder inputs the next coefficient (920) and 
continues the encoding process. 

B. Variable-dimension Vector Huffman Decoding 

25 [0127] Figure 1 0 shows a VDVH decoding technique (1 000) corresponding to the VDVH encoding technique (700) 
shown in Figure 7. For example, a decoder uses the technique (1000) to decode directly encoded signal levels for 
frequency coefficients of audio data. Alternatively, the decoder uses the technique to decode another form of audio data . 
[01 28] The decoder gets (1010) the next Huffman code for an n-dimension vector Huffman coding table. For example, 
the decoder gets the next Huffman code for 4 symbols in sequence. 

30 [01 29] The decoder checks (1 020) whether the Huff inan code is the escape code for the n-dimension vector Huffman 
coding table. If not, the decoder gets (1 030) the n symbols represented by the Huffinan code. For example, the decoder 
gets the 4 symbols associated with the Huffinan code in a 4-dimensional vector Huffman codebook. 
[0130] If code is the escape code, the n-dimension codebook does not include a code for the vector, and the decoder 
gets (1040) Huffinan codes for smaller vectors and/or scalars. For example, the decoder gets codes for x n/x-symbol 

35 vectors. For each n/x symbol vector, the decoder recursively repeats the decoding technique, exiting when the n/x 
symbol vector or its constituent vectors/scalars are decoded. 

[0131] The decoder then checks (1050) whether there are any additional codes for the n-dimension vector Huffman 
coding table to decode. If not, the decoder exits. Otherwise, the decoder gets (1010) the next such Huffinan code. 

40 1 . Example Implementation 

[0132] Figure 11 shows a detailed technique (1100) for decoding vectors coded using VDVH encoding in one imple- 
mentation. The decoding technique (1100) corresponds to the encoding technique (800) shown in Figure 8. 
[0133] Referring to Figure 11 , the decoder gets the next code for an n-dim vector Huffinan code table (1110). The 
« decoder checks if the code is the escape code for the n-dim vector Huffinan code table (1120). If not, the decoder gets 
the n symbols represented by the code in the n-dim vector table (1122). The decoder continues until the decoder has 
finished processing the encoded data (1124). 

[0134] If the code is the escape code for the n-dim vector Huffinan code table, the decoder decodes the n-dim vector 
as two n/2-dim vectors using a n/2-dim vector Huffinan code table. Specifically, the decoder gets the next code for the 
50 n/2-dim vector Huffman code table (11 30). The decoder checks if the code is the escape code for the n/2-dim vector 
Huffinan code table (1140). If not, the decoder gets the n/2 symbols represented by the code in the n/2-dim vector 
Huffman code table (1142). The decoder continues processing the codes for the n/2-dim vector Huffinan code table 
until the processing of such codes is complete (1144). 

[0135] If the code is the escape code for the n/2-dim vector Huffman code table, the decoder decodes the n/2-dim 
55 vector as two n/4-dim vectors, which may be scalars, etc. 

[0136] The decoder generally follows this pattern of decoding larger-dimension vectors as two smaller-dimension 
vectors when escape codes are detected, until the vectors to be decoded are scalars (1-dim vectors). At that point, 
the decoder gets the next code for a scalar Huffman code table (1 150). The decoder checks if the code is the escape 
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code for the scalar Huffman code table ( 1 1 60). If not, the decoder gets the scalar represented by the code in the scalar 
Huffinan code table (1162). The decoder continues processing the codes forthescalars until processing of such codes 
is complete (1 1 64). If the code is the escape code for the scalar Huffinan code table, the scalar is coded using a table- 
less technique, and the decoder gets the value (11 70). 
5 [0137] Alternatively, the decoder uses tables with different dimension sizes and/or uses tables that split vectors in 
some way other than by power of 2 in VDVH decoding. 

2. Adaptive Switching 

io [0138] Figure 12 shows a technique (1200) for decoding vectors encoded using VDVH encoding according to one 
implementation, where the decoder adaptively determines a switch point for changing to decoding of run lengths and 
signal levels. The adaptive switch point depends on a count of consecutive zero-value coefficients in the data, which 
are signal levels for quantized transform coefficients, progressing from the lowest-frequency coefficient to the highest- 
frequency coefficient. Alternatively, the data are another form and/or organization of audio data. 

'5 [0139] To start, the decoder initializes several variables. Specifically, the decoder sets a run count to 0 (1210) and 
sets a decoding state to DVDVH (1212). 

[0140] The decoder decodes the next vector by looking up the code for that vector in a Huffman coding table (1220). 
For example, the decoder performs the decoding technique (11 00) shown in Figure 11 . The decoder then updates the 
run count based on the decoded vector (1230) (specifically, using the number of zero values in the decoded vector to 

20 reset, increment, or otherwise adjust the run count). 

[0141] The decoder checks if the run count exceeds a threshold (1240). The run count threshold can be static or it 
can depend on a factor such as the size of a block of coefficients (e.g., four zeroes in an input sequence of 256 
coefficients), or it can be adaptive in some other way. If the run count exceeds the threshold, the decoder begins 
decoding the encoded coefficients using run-level decoding (1250). Run-level decoding can be performed in several 

25 ways, including, for example, Huffman decoding, vector Huffman decoding, or context-based arithmetic decoding. 
[0142] In some embodiments, run-level decoding is performed using Huffman decoding with two potential Huffinan 
code tables, where one table is used for decoding data in which shorter runs are more likely, and one table is used for 
decoding data in which longer runs are more likely. When the decoder receives a code, a signal bit in the code indicates 
which table the encoder used, and the decoder looks up the code in the appropriate table. 

30 [0143] If the run count does not exceed the threshold, the decoder continues processing vectors until decoding is 
finished (1260). 

V. Context-based Arithmetic Coding and Decoding 

35 [0144] In some embodiments, an encoder such as the encoder (200) of Figure 2 uses context-based arithmetic 
["CBA") coding to code sequences of audio data. In CBA coding, different probability distributions for the input symbols 
are associated with different contexts. The probability distribution used to encode the input sequence changes when 
the context changes. The context can be calculated by measuring different factors that are expected to affect the 
probability of a particular input symbol appearing in an input sequence. A decoder such as the decoder (300) of Figure 

40 3 performs corresponding arithmetic decoding. 

[0145] When encoding coefficients directly (i.e., as direct levels), the encoder uses factors including the values of 
the previous coefficients in the sequence to calculate the context. When encoding coefficients using run-level encoding, 
the encoder uses factors including the lengths of the current run and previous runs, in addition to the values of previous 
coefficients, to calculate the context. The encoder uses a probability distribution associated with the calculated context 
to determine the appropriate arithmetic code for the data. Thus, by using the various factors in calculating contexts, 
the encoder determines contexts adaptively with respect to the data and with respect to the mode (i.e., direct, run- 
level) of representation of the data. 

[01 46] In alternative embodiments, the encoder may use additional factors, may omit some factors, or may use the 
factors mentioned above in other combinations. 

50 

A. Example Implementation of Contexts 

[0147] Tables 2-5 and Figures 13A - 13D , 14A - 14H, and 15A - 15H show contexts and probability distributions, 
respectively, used in CBA encoding and decoding in an example implementation. Alternatively, CBA encoding and 
55 decoding use different contexts and/or different probability distributions. 

[0148] Although the following discussion focuses on context calculation in the encoder in the example implementa- 
tion, the decoder performs corresponding context calculation during decoding using previously decoded audio data. 
[0149] As noted above, the encoder can encode coefficients using CBA encoding whether the encoder is coding 
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direct levels only or run lengths and direct levels. In one implementation, however, the techniques for calculating con- 
texts vary depending upon whether the encoder is coding direct levels only or run lengths and direct levels. In addition, 
when coding run lengths and direct levels, the encoder uses different contexts depending on whether the encoder is 
encoding a run length or a direct level. 

5 [0150] The encoder uses a four-context system for calculating contexts during arithmetic encoding of direct levels 
using causal context. The encoder calculates the context for a current level L[n] based on the value of the previous 
level (L[n-1 ]) and the level just before the previous level (L[n-2]). This context calculation is based on the assumptions 
that 1) if previous levels are low, the current level is likely to be low, and 2) the two previous levels are likely to be better 
predictors of the current level than other levels. Table 2 shows the contexts associated with the values of the two 

10 previous levels in the four-context system. Figures 1 3A-1 3D show probability distributions for current levels for these 
contexts. 



Table 2: 



Contexts for CBA encoding/decoding of direct 
levels 


L[n-1] 


L[n-2J 


Context 


=0 


=0 


0 


= 0 


>1 


1 


= 1 


Any 


2 


>2 


Any 


3 



The probability distributions in Figures 13A-13D assume that when the two previous levels are zero or near-zero, the 
current level is more likely to be zero or near-zero. 

[0151] The encoder also can use CBA coding when performing run-length coding of levels. When encoding a run 
length, factors used by the encoder to calculate context include the percentage of zeroes in the input sequence (a 
running total over part or all of the sequence) and the length of the previous run of zeroes (R[n-1]). The encoder 
calculates a zero percentage index based on the percentage of zeroes in the input sequence, as shown below in Table 3: 



Table 3: 



Zero percentage indices for CBA encoding/decoding of run lengths 


Zero% 


Zero % index 


>90 


0 


>80 


1 


>60 


2 


<60 


3 



[0152] The encoder uses the zero percentage index along with the length of the previous run to calculate the context 
for encoding the current run length, as shown below in Table 4. Figures 14A-14H show probability distributions for 
different run-length values associated with these contexts. 

45 

Table 4: 



Contexts for CBA encoding/decoding of run lengths 


Zero % index 


R[n-1] 


Context 


0 


=0 


0 


0 


>0 


4 


1 


=0 


1 


1 


>0 


5 


2 


=0 


2 


2 


>0 


6 
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Table 4: (continued) 



Contexts for CBA encoding/decoding of run lengths 


Zero % index 


R[rMJ 


Context 


3 


=0 


3 


3 


>0 


7 



For example, in an input sequence where 91 % of the levels are zeroes (resulting in a zero percentage index of 0), 
and where the length of the previous run of zeroes was 15, the context is 4. The probability distributions in Figures 
14A-14H show that when the percentage of zeroes in an input sequence is higher, longer run lengths are more likely. 
The probability distributions also assume that within a given zero percentage Index, run lengths following a run length 
of zero are likely to be shorter than run lengths following a run length greater than zero. 

[0153] When encoding a level in run-level data, factors used by the encoder to calculate context include the length 
of the current run (R[n]), the length of the previous run (R[n-1]), and the values of the two previous levels (L[n-1] and 
L([n-2]). This context calculation is based on the observation that the current level is dependent on the previous two 
levels as long as the spacing (i.e., run lengths) between the levels is not too large. Also, if previous levels are lower, 
and if previous runs are shorter, the current level is likely to be low. When previous runs are longer, the previous level 
has less effect on the current level. 

[0154] The contexts associated with the values of the current run length, previous run length, and the two previous 
levels are shown below in Table 5. Figures 15A-15H show probability distributions for levels associated with these 
contexts. 



Table 5: 



Contexts for CBA encoding/decoding of levels in run-level 
encoding 


R[n] 


R[n-1] 


L[n-1] 


L[n-2] 


Context 


>2 


Any 


Any 


Any 


0 


<2 


22 


= 1 


Any 


1 


<2 


>2 


= 2 


Any 


2 


<2 


22 


>2 


Any 


3 


<2 


<2 


=1 


=1 


4 


<2 


<2 


=1 


>1 


5 


<2 


<2 


=2 


Any 


6 


<2 


<2 


>2 


Any 


7 



[01 55] For example, in an input sequence where the length of the current run of zeroes is 1 , the length of the previous 
run of zeroes is 2, and the previous level is 1 , the context is 1 . The probability distributions in Figures 15A-15H show 
that when the previous levels are lower, and when current and previous run lengths are shorter, the current level is 
more likely to be zero or near zero. 

B. Adaptive Switching 

[0156] Figure 1 6 shows a technique (1 600) for CBA coding of coefficients of direct signal levels where the encoder 
adaptively determines a switch point for changing to coding of run lengths and signal levels according to one imple- 
mentation. The adaptive switch point depends on a count of consecutive zero-value coefficients. The input data are 
signal levels for quantized transform coefficients, progressing from the lowest-frequency coefficient to the highest- 
frequency coefficient. Alternatively, the input data are another form and/or organization of audio data. 
[01 57] To start, the encoder initializes several variables. Specifically, the encoder sets a run cou nt variable to 0 (1 61 0) 
and sets an encoding state variable to direct context-based arithmetic (DCBA) (1612). 

[01 58] The encoder receives the next coefficient QC as input (1 620). The encoder then checks ( 1 630) if the coefficient 
is zero. If the coefficient QC is non-zero, the encoder resets the run count (1638) and codes the coefficient using DCBA 
encoding (1640). 
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[01 59] Otherwise (i.e., if the coefficient QC is zero), the encoder increments the run count variable (1 632), and checks 
to see whether the current run count exceeds the run count threshold (1 634). The run count threshold can be static or 
it can depend on a factor such as the size of a block of coefficients (e.g., four zeroes in an input sequence of 256 
coefficients), or it can be adaptive in some other way. For example, the threshold may be increased or decreased, with 
5 or without regard to the number of coefficients in an input sequence. If the run count exceeds the threshold, the encoder 
changes the encoding state to run-level encoding ["RLE"] (1636). The encoder then codes the coefficient using DCBA 
encoding (1 640). 

[01 60] After encoding the coefficient, the encoder checks the encoding state (1 650). If the encoding state is no longer 
DCBA (e.g., if the encoder has changed the encoding state to RLE as a result of exceeding a threshold number of 

10 zero coefficients), the encoder begins encoding of the coefficients as ru n lengths and levels (1 660). Run-level encoding 
can be performed in several ways, including, for example, Huffman coding, vector Huffman coding, or CBA coding 
(potentially with different contexts than the earlier CBA coding, as described above). In some embodiments, run-level 
encoding is performed using Huffman coding with two Huffman code tables, where one table is used for encoding data 
in which shorter runs are more likely, and one table is used for encoding data in which longer runs are more likely. The 

is encodertries each table, and chooses codes from one of the tables, with a signal bit Indicating which table the encoder 
used. 

[01 61 ] If the encoding state has not changed, the encoder determines (1 670) whether there are any more coefficients 
to be encoded. If so, the encoder inputs the next coefficient (1620) and continues the encoding process. 

20 c. Context-based Arithmetic Decoding 

[01 62] Figure 1 7 shows a technique (1 700) for decoding coefficients encoded using CBA encoding according to one 
implementation, where the decoder adaptively determines a switch point for changing to decoding of run lengths and 
signal levels. The adaptive switch point depends on a count of consecutive zero-value coefficients in the data, which 
25 are signal levels for quantized transform coefficients, progressing from the lowest-frequency coefficient to the highest- 
frequency coefficient. Alternatively, the data are another form and/or organization of audio data. 
[0163] To start, the decoder initializes several variables. Specifically, the decoder sets a run count to 0 (1710) and 
sets a decoding state to direct context-based arithmetic (DCBA) (1 712). 

[0164] The decoder decodes the next quantized coefficient using DCBA (1 720) by looking at the number the encoder 
30 used to represent the coefficient in arithmetic encoding, and extracting the value of the coefficient from that number. 
The decoder then updates the run count based on the decoded coefficient (1730) (specifically, based on whether the 
decoded coefficient is a zero value to reset or increment the run count). 

[0165] The decoder checks if the run count exceeds a threshold (1 740). The run count threshold can be static or it 
can depend on a factor such as the size of a block of coefficients (e.g., four zeroes in an input sequence of 256 

35 coefficients), or it can be adaptive in some other way. If the run count exceeds the threshold, the decoder begins 
decoding the encoded coefficients using run-level decoding (1750). Run-level decoding can be performed in several 
ways, including, for example, Huffman decoding, vector Huffman decoding, or CBA decoding (potentially with different 
contexts than the earlier CBA decoding, as described above). In some embodiments, run-level decoding is performed 
using Huffman decoding with two potential Huffman code tables, where one table is used for decoding data in which 

*o shorter runs are more likely, and one table is used for decoding data in which longer runs are more likely. When the 
decoder receives a code, a signal bit in the code indicates which table the encoder used, and the decoder looks up 
the code in the appropriate table. 

[0166] If the run count does not exceed the threshold, the decoder continues processing coefficients until decoding 
Is finished (1760). 

45 

VI. Table-less Coding 

[0167] In some embodiments using Huffman coding, an encoder such as the encoder (200) of Figure 2 uses an 
escape code for a Huffman code table to indicate that a particular symbol (or combination of symbols) does not have 
50 an associated code in the table. Sometimes, an escape code is used to indicate that a particular symbol (e.g., a scalar 
value for a level that is not represented in a scalar Huffman code table for levels, a run length that is not represented 
in a scalar Huffman code table for run lengths, etc.) is to be encoded without using a code from a Huffman table. In 
other words, the symbol is to be encoded using a "table-less" coding technique. 

[0168] In some embodiments using arithmetic coding, an escape code is sometimes used to indicate that a particular 
55 symbol is not to be coded arithmetically. The symbol could be encoded using a code from a Huffman table, or it could 
also be encoded using a "table-less" encoding technique. 

[01 69] Some table-less coding techniques use fixed-length codes to represent symbols. However, using fixed-length 
codes can lead to unnecessarily long codes. 
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[0170] In some embodiments, therefore, symbols such as quantized transform coefficients are represented with 
variable length codes in a table-less encoding technique when the symbols are not otherwise encoded. A decoder 
such as the decoder (300) of Figure 3 performs a corresponding table-less decoding technique. 
[0171] For example, Table 6 shows pseudo-code for one implementation of such a table-less encoding technique. 



If(value<2 8 ) { 
Send "0"; 

Send value using 8 bits; 

} 

else if (value <2 16 ) { 
Send "10"; 

Send value using 16 bits 

else if (value < 2 24 ) { 
Send "110"; 

Send value using 24 bits; 

} 

else if (value <2 31 ){ 
Send "111"; 

Send value using 31 bits; 

} 

Table 6: Pseudo-code for table-less coding technique in one 
implementation 

30 

[0172J The number of bits the encoder uses to encode the coefficient depends on the value of the coefficient. The 
encoder sends a one, two, or three-bit value to indicate the number of bits used to encode the value, and then sends 
the encoded value itself using 8, 16, 24 or 31 bits. The total number of bits the encoder uses to encode the coefficient 
ranges from 9 bits for a value less than 2 s to 34 bits for a value greater than or equal to 2 24 , but less than 2 31 . 
35 [0173] For a series of coefficients, the average bits sent will be equal to: 

P(0 £C < 2 8 ) * 9 + P(2 8 <C < 2 16 ) * 18 + P(2 16 £C < 2 24 ) * 27 + P(2 24 < 2 31 ) * 34, 

40 where P(m <C < n) is the probability of occurrence in an input sequence of a coefficient C within the range indicated. 
Significant bit savings are therefore possible when a large percentage of coefficients are small (e.g., less than 2 16 ). 
[0174] Alternatively, the encoder and decoder use another table-less encoding/decoding technique. 
[0175] Having described and illustrated the principles of our invention with reference to various described embodi- 
ments, it will be recognized that the described embodiments can be modified in arrangement and detail without de- 

45 parting from such principles. It should be understood that the programs, processes, or methods described herein are 
not related or limited to any particular type of computing environment, unless indicated otherwise. Various types of 
general purpose or specialized computing environments may be used with or perform operations in accordance with 
the teachings described herein. Elements of the described embodiments shown in software may be implemented in 
hardware and vice versa. 

50 [01 76] In view of the many possible embodiments to which the principles of our invention may be applied, we claim 
as our invention all such embodiments as may come within the scope and spirit of the following claims and equivalents 
thereto. 



55 Claims 

1 . In a computer system, a method of encoding audio data comprising: 
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encoding a first portion of an audio data sequence in a direct variable-dimension vector Huffman encoding 
mode; 

switching to a run-level encoding mode at a switch point; and 

encoding a second portion of the audio data sequence in the run-level encoding mode. 

5 

2. The method of claim 1 further comprising sending a flag in an encoded bitstream, wherein the flag indicates the 
switch point. 

3. The method of claim 1 wherein the first portion of the audio data sequence consists primarily of non-zero quantized 
io audio coefficients, and wherein the second portion of the audio data sequence consists primarily of zero-value 

quantized audio coefficients. 

4. The method of claim 1 wherein the switch point is a pre-determined switch point. 

15 5. The method of claim 4 wherein the pre-determined switch point is determined experimentally by testing efficiency 
of encoding the audio data sequence using the pre-determined switch point. 

6. The method of claim 1 wherein the switch point is adaptively determined. 

20 7. The method of claim 1 further comprising: 

switching to a third encoding mode at a second switch point. 

8. The method of claim 1 wherein the run-level encoding mode comprises context-based arithmetic encoding of run 
25 lengths and levels. 

9. The method of claim 1 wherein the run-level encoding mode comprises Huffman coding of run lengths and levels. 

10. The method of claim 1 wherein the run-level encoding mode comprises vector Huffman coding of run lengths and 
30 levels. 

11. A computer-readable medium storing computer-executable instructions for causing an audio encoder to perform 
the method of claim 1 . 

55 12. In a computer system, a method of encoding audio data comprising: 

encoding a first portion of an audio data sequence in a direct context-based arithmetic encoding mode; 

switching to a run-level encoding mode at a switch-point; and 

encoding a second portion of the audio data sequence in the run-level encoding mode. 

40 

13. The method of claim 12 wherein the run-level encoding mode comprises context-based arithmetic encoding of run 
lengths and levels. 

14. A computer-readable medium storing computer-executable instructions for causing an audio encoder to perform 
*5 the method of claim 1 2. 

15. In a computer system, a method of decoding audio data comprising: 

decoding a first portion of an encoded audio data sequence in a direct variable-dimension vector Huffman 
50 decoding mode; 

switching to a run-level decoding mode at a switch point; and 

decoding a second portion of the encoded audio data sequence in the run-level decoding mode. 

16. The method of claim 1 5 further comprising: 

55 

prior to the switching, receiving a flag indicating the switch point. 

17. The method of claim 15 wherein the first portion of the encoded audio data sequence consists primarily of non- 
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zero quantized audio coefficients, and 

wherein the second portion of the encoded audio data sequence consists primarily of zero-value quantized audio 
coefficients. 

18. The method of claim 15 wherein the switch point is a pre-determined switch point. 

19. The method of claim 15 wherein the switch point is adaptively determined. 

20. The method of claim 15 further comprising: 

switching to a third decoding mode at a second switch point. 

21. The method of claim 15 wherein the run-level decoding mode comprises context-based arithmetic decoding of run 
lengths and levels. 

22. The method of claim 15 wherein the run-level decoding mode comprises Huffman decoding of run lengths and 
levels. 

23. The method of claim 15 wherein the run-level decoding mode comprises vector Huffman decoding of run lengths 
and levels. 

24. A computer-readable medium storing computer-executable instructions for causing an audio decoder to perform 
the method of claim 15. 

25. In a computer system, a method of decoding audio data comprising: 

decoding a first portion of an encoded audio data sequence in a direct context-based arithmetic decoding 
mode; 

switching to a run-level decoding mode at a switch-point; and 

decoding a second portion of the audio data sequence in the run-level decoding mode. 

26. The method of claim 25 wherein the run-level decoding mode comprises context-based arithmetic decoding of run 
lengths and levels. 

27. A computer-readable medium storing computer-executable instructions for causing an audio decoder to perform 
the method of claim 25. 

28. In a computer system, a method of encoding data comprising plural symbols, the method comprising: 

encoding a first vector comprising a first number of symbols, wherein the encoding the first vector comprises: 

selecting a first code table from a set of plural code tables based on the first number of symbols; and 
representing the first vector with a code from the first code table; and 

encoding a second vector comprising a second number of symbols, wherein the second number of symbols 
differs from the first number of symbols. 

29. The method of claim 28 wherein the first number of symbols is greater than the second number of symbols, and 
wherein the first vector has a higher probability of occurrence than the second vector. 

30. The method of claim 28 wherein the encoding the second vector comprises: 

selecting a second code table based on the second number of symbols; and 
representing the second vector with a code from the second code table, 

wherein the second code table differs from the first code table. 

31. The method of claim 28 wherein the first code table comprises: 
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codes for representing probable vectors of a set of possible vectors having the first number of symbols; and 
an escape code. 

32. The method of claim 28 wherein the first number of symbols differs from the second number of symbols by a factor 
5 of 2. 

33. The method of claim 28 wherein the second number of symbols is 1 , and wherein the encoding a second vector 
comprises: 

io representing the second vector with a code obtained by a table-less encoding technique. 

34. The method of claim 28 further comprising: 

encoding a third vector comprising a third number of symbols, wherein the third number of symbols differs 
*5 from the first number of symbols and the second number of symbols, and wherein the encoding the third vector 

comprises: 

selecting a third code table based on the third number of symbols; and 
representing the third vector with a code from the third code table, 

20 

wherein the third code table differs from the first code table and the second code table. 

35. A computer-readable medium storing computer-executable instructions for causing a computer perform the method 
of claim 28. 

25 

36. In a computer system, a method of decoding data comprising plural encoded vectors, the method comprising: 

decoding a first vector, wherein the decoding the first vector comprises: 

30 receiving a first code representing a first vector, the first vector having a first number of symbols; 

looking up the first code in a first code table in a group of plural code tables; 
determining whether the first code is an escape code; 
if the first code is an escape code: 

35 receiving a second code representing the first vector, wherein the second code is not included in the 

first code table; and 

decoding the second code; if the first code is not an escape code: 

looking up symbols for the first vector in the first code table; and 
4 ° including the symbols in a decoded data stream; 

wherein the first number of symbols is a basis for whether the first code is an escape code or not an escape 

code. 

45 37. The method of claim 36 wherein the decoding the second code comprises: 

looking up the second code in a second code table in the group of plural code tables; 
determining whether the second code is an escape code; 
if the second code is an escape code: 

50 

receiving a third code representing the first vector, wherein the third code is not included in the second 

code table; and 

decoding the third code; and 

55 if the second code is not an escape code: 



looking up symbols for the first vector in the second code table; and 
including the symbols in the decoded data stream; 
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wherein the second code table differs from the first code table. 

38. The method of claim 36 wherein the first vector comprises one symbol, and wherein the decoding the second code 
comprises: 

5 

finding the one symbol using a table-less decoding technique; and 
including the one symbol in the decoded data stream. 

39. The method of claim 36 further comprising: 

10 

decoding a second vector, wherein the second vector has a second number of symbols, and wherein the first 
number differs from the second number by a factor of 2. 

40. A computer-readable medium storing computer-executable instructions for causing a computer perform the method 
15 of claim 36. 

41. In a computer system, a method of encoding audio data coefficients using a table-less encoding technique, the 
method comprising: 

20 if an audio data coefficient is within a first value range, encoding the audio data coefficient with a one-bit code 

followed by an 8-bit encoded value; 

if the audio data coefficient is within a second value range, encoding the audio data coefficient with a two-bit 
code followed by a 16-bit encoded value; 

if the audio data coefficient is within a third value range, encoding the audio data coefficient with a three-bit 
25 code followed by a 24-bit encoded value; and 

if the audio data coefficient is within a fourth value range, encoding the audio data coefficient with a different 
three-bit code followed by a 31 -bit encoded value; 

42. A computer-readable medium storing computer-executable instructions for causing an audio encoder to perform 
30 the method of claim 41 . 

43. In a computer system, a method of encoding audio data in a vector Huffman encoding scheme, the method com- 
prising: 

35 determining a Huffman code from a Huffinan code table to use for encoding a vector of audio data symbols, 

wherein the determining is based on a sum of values of the audio data symbols; and 
encoding the vector of audio data symbols using the Huffman code. 

44. The method of claim 43 wherein the Huffman code is an escape code, wherein the vector of audio data symbols 
is an n-dimension vector, and wherein the escape code indicates that the n-dimension vector is to be encoded as 
x n/x-dimension vectors using at least one different Huffman code table. 

45. The method of claim 43 wherein the determining comprises comparing the sum of values with a threshold, and 
wherein the threshold depends on a number of audio data symbols in the vector. 

45 

46. The method of claim 45 wherein the number of audio data symbols is 4, and wherein the threshold is 6. 

47. The method of claim 45 wherein the number of audio data symbols is 2, and wherein the threshold is 16. 

50 48. The method of claim 45 wherein the number of audio data symbols is 1 , and wherein the threshold is 100. 

49. A computer-readable medium storing computer-executable instructions for causing an audio encoder to perform 
the method of claim 43. 

55 50. In a computer system, a method of encoding a sequence of audio data coefficients, the method comprising: 
receiving the sequence of audio data coefficients; and 

encoding at least part of the sequence of audio data coefficients using context-based arithmetic encoding. 
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51. In a computer system, a method of decoding an encoded sequence of audio data coefficients, the method com- 
prising: 

receiving the encoded sequence of audio data coefficients; and 

decoding at least part of the encoded sequence of audio data coefficients using context-based arithmetic 
decoding. 

52. In a computer system, a method of encoding audio data coeff relents using context-based arithmetic coding, wherein 
one or more contexts have associated probability distributions, and wherein the probability distributions represent 
probabilities of coefficients in an audio input sequence, the method comprising: 

adaptively determining a context for a current coefficient in the audio input sequence based at least in part on 
a mode of representation of the current coefficient; and 
encoding the current coefficient using the context. 

53. The method of claim 52 wherein the mode of representation is direct representation, and wherein the adaptively 
determining a context for the current coefficient further comprises: 

finding direct levels of previous coefficients in the audio input sequence; and 

determining the context based at least in part on the direct levels of the previous coefficients. 

54. The method of claim 53 wherein the previous coefficients comprise two coefficients immediately preceding the 
current coefficient in the audio input sequence. 

55. The method of claim 52 wherein the mode of representation is run-level representation, and wherein the adaptively 
determining a context for the current coefficient further comprises: 

finding a percentage of zero-value coefficients in the audio Input sequence; finding a previous run length for 
a previous run of zero-value coefficients in the audio input sequence; and 

determining the context based at least in part on the percentage of zero-value coefficients and the previous 
run length. 

56. The method of claim 52 wherein the mode of representation is run-level representation, and wherein the adaptively 
determining a context for the current coefficient further comprises: 

finding a current run length of a current run of zero-value coefficients in the audio input sequence; 
finding a previous run length of a previous run of zero-value coefficients in the audio input sequence; 
finding previous direct levels of previous coefficients in the audio input sequence; and 
determining the context based at least in part on the current run length, the previous run length, and the 
previous direct levels. 

57. A computer-readable medium storing computer-executable instructions for causing a computer to perform the 
method of claim 52. 

58. In a computer system, a method of encoding audio data using an entropy encoder, the method comprising: 

coding a first portion of the audio data, wherein the coding of the first portion comprises direct coding of co- 
efficients; 

maintaining a count of consecutive coefficients equal to a predominant value, 

wherein the count increases if a current coefficient's value is equal to the predominant value; and 
in response to the count exceeding a threshold, coding a second portion of the audio data, wherein the coding 
of the second portion comprises run-level coding of coefficients. 

59. The method of claim 58 wherein the predominant value is zero. 

60. The method of claim 58 wherein the threshold value is static. 
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61. The method of claim 58 wherein the threshold is determined adaptively. 

62. The method of claim 58 wherein the first portion comprises a block of coefficients, the block having a size, and 
wherein the threshold depends on the size. 

5 

63. The method of claim 62 wherein the size is 256 coefficients, and 

wherein the threshold is 4. 

64. The method of claim 62 wherein the size is 51 2 coefficients, and 
io wherein the threshold is 8. 

65. In a computer system, a method of decoding audio data using an entropy decoder, the method comprising: 

decoding a first portion of the audio data, wherein the coding of the first portion comprises direct decoding of 
*5 coefficients; 

maintaining a count of consecutive coefficients equal to a predominant value, 

wherein the count increases if a current coefficient's value is equal to the predominant value; and 
in response to the count exceeding a threshold, decoding a second portion of the audio data, wherein the 
20 decoding of the second portion comprises run-level decoding of coefficients. 

66. The method of claim 65 wherein the predominant value is zero. 

67. The method of claim 65 wherein the threshold is static. 

68. The method of claim 65 wherein the threshold is determined adaptively. 

69. The method of claim 65 wherein the first portion comprises a block of coefficients, the block having a size, and 
wherein the threshold depends on the size. 

70. The method of claim 69 wherein the size is 256 coefficients, and 

wherein the threshold is 4. 

71. The method of claim 69 wherein the size is 512 coefficients, and 
55 wherein the threshold is 8. 

72. In a computer system, a method of encoding audio data comprising a sequence of audio coefficients using run- 
level encoding, the method comprising: 

40 encoding a first portion of the sequence using codes from a first code table, wherein the first code table is 

used by an encoder when longer runs of consecutive coefficients equal to a predominant value are more likely; 
and 

encoding a second portion of the sequence using codes from a second code table, wherein the second code 
table is used by the encoder when shorter runs of consecutive coefficients equal to the predominant value are 
*s more likely. 

73. The method of claim 72 wherein the predominant value is zero. 

74. The method of claim 72 further comprising indicating use of the first or second code table with a signal bit. 

50 

75. In a computer system, a method of entropy decoding audio data comprising a sequence of audio coefficients using 
run-level decoding, the method comprising: 

decoding a first portion of the sequence by looking up codes in a first code table, wherein the first code table 
55 is used by a decoder when longer runs of consecutive coefficients equal to a predominant value are more 

likely; and 

decoding a second portion of the sequence by looking up codes in a second code table, wherein the second 
code table is used by the decoder when shorter runs of consecutive coefficients equal to a predominant value 
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are more likely. 

76. The method of claim 75 wherein the predominant value is zero. 
5 77. The method of claim 75 further comprising, prior to the decoding the first portion; 

receiving a signal bit indicating whether the first or second code table was used by an encoder. 
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